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abstract 

This  paper  deal s  with  problems  of  quantitative 
organizational  design.  We  show-  that  the  optimal  a-ch::ecture 
of  ever,  a  very  simple  team  of  two  decision  matters  fDMs) 
performing  binary  hypothesis  testing  depends  or.  variables 
external  to  Pie  team.  Or.  the  oPier  hand,  mere  exist  particular 
probability  distributions  for  the  observations  which  lead  to 
unambiguous  optima',  architectures  itt  which  the  "better' 
decision  maker  makes  the  final  team  decision  based  upon 
finite-bit  messages  from  the  'worse"  decision  maker.  But. 
ever,  in  Piese  cases  Pie  results  are  difficult  to  generalize  for 
teams  with  Pnree  o:  core  DMs.  because  of  the  complexity  of 
me  problem.  A  heur.su:  aigor.Pim  for  organization  design  is 

1.  INTRODUCTION  AND  MOTIVATION 

Our  main  research  goal  is  to  develop  basic 
understanding  of  decision  mailing  :r.  distributed 
organizations.  As  we  shall  see  such  problems  can  become 
very  complicated  because  of  the  cistricuted  (decentralized) 
decision  process.  In  order  to  gain  understanding  into  the 
basic  fundamental  issues  we  need  a  paradigm  which 
represents  simple  decision  mailing,  and  whose  centralized 
version  is  easy  to  formulate,  solve,  ar.a  compute.  We  have 
adopted  the  problem  of  hypothesis  testing  as  our  basic 
raradign:  see  references  [If  to  [-]  for  related  prior  research 

ir»  IF. IS  p a r 

The  clzssic  d-cisior.  r?ro ir.  this  ssrtirr  rslcrcs  10  ih? 
design  a  :aar.  10  perform  tares:  detector,  (no  tares:  vs  tares: 
present)  usmg  several  cisar  ouied  sensors.  Suppose  Pi  a:  each 
sensor  has  significant  computational  capability  tc  process  ins 
raw  returns  and  car.  perform  local  target  detection.  Because 
of  Pie  unreliability  and  uncertainty  of  me  observauor.s  Piece 
is  a  higr.  probability  of  error  associated  w:m  each,  sense:  s 
cec.sior.  when  he  ccerates  m  isolation.  Thus,  it  is  cestrcoie 
to  r.ave  many  sensors  to  operate  together  as  a  team  to 
decrease  Pie  error  probability.  In  order  to  achieve  thus,  we 
have  to  define  me  architecture  of  the  crcar.izauor  fi.e.  which 
se:. .-or  ccmmu.iiocies  w;:r.  whom  arc  derive  a  decision 
prrtocol  to  fuse  me  '  tentative'  sensor  decisions  tr.to  a  glona’ 
mam  decision. 


We  employ  a  binary  hypothesis  testing  model,  which 
can  be  generalized  to  more  genera i  hypothesis  lesnr.g 
problems.  These  are  indeed  generic  in  the  situation 
assessment  C:  function.  We  would  like  to  develop  a 
quantitative  design  mepiodology  to  deal  wiai  fieri. 


We  examine  several  important  issues  of  Piese  problem.:, 
starting  with  real-time  decision  making  rules  tor  distributed 
hypoPiesis  tesung.  The  team  architerture  is  me  way  me  DMs 
of  the  team  are  set-up.  We  want  to  obtain  the  perfc—  ...ice  of 
a  giver,  team,  architecture  (say  Pie  probability  of  err.r:  and 
compare  the  performance  or  alternative  architectures.  We 
also  seek  to  design  an  organization  to  meet  some  clock  team 
performance  specifications  and  stuay  me  effect  of  adding  a 
new  DM  to  the  team.  Finally,  we  would  like  tc  unaerstar.d 
and  develop  the  theoretical  aspect-  and  computational 
complexity  associated  with  Phis  class  of  problems. 

Suppose  that  a  team,  consists  of  N  DMs.  Evidently.  Pie 
team  may  have  many  alternative  arcniiectures  and 
communication  protocols.  For  example,  if  N  =  3.  we  car.  see 
two  different  architectures  :r.  Figure  la  ar.d  lb.  Tr.c 
environment  consists  of  several  h.yootheses.  Each  DM 
receives  a  conditionally  ir.deper.cer.t  observation  ar.d  makes  a 
tentative  decision,  based  uoon  hus  owr.  measurement  and  me 
decisions  of  Pie  other  crocessors  which  r.ave  beer,  transmitted 
to  him,  according  to  some  specified  commur.icattc-r. 
protocols.  The  final  team  decision  has  some  costs  associated 
with  it.  We  would  like  tc  determine  somehow  which 
configuration  results  tr.to  suoeticr  performance:  moreover, 
given  Pnree  DMs  and  a  particular  configuration.  we  would 
like  to  determine  which  DM  shou.d  be  emp.oyea  each 
position.  We  would  also  Eke  to  test  Pie  effects  of  different 
communication  protocols.  Another  type  of  prorlem  :s 
illustrated  ir.  Figure  1c.  Giver,  a  team  of  DMs  whicr.  cues  net 
meet  certain  specifications.  we  would  line  to  determine  what 


assumed  binary .  In  S 
configuration  of  a  tea: 
we  examine  the  same 
observations  of  the 


distributions  with  different  variances  under  each  hypothesis. 
In  Section  4,  we  present  a  problem  of  organizational  design 
and  an  algorithm  to  solve  it.  Finally  in  Section  5.  we  present 
some  concluding  remarks  and  suggestions  for  future 
research. 

2.  TWO  DM  ORGANIZATIONS 
2.1  General  Remarks 

Since  organizations  with  two  DMs  are  key  building 
blocks  for  larger  organizations,  our  objective  is  to  study  them 
extensively  and  analyze  them  completely.  There  are  two 

alternative  architectures  for  this  type  of  teams:  fusion  and 
tandem  (Figure  2).  Since  the  DMs  in  the  tandem  architecture 
car,  always  employ  the  decision  rules  of  the  DMs  in  the 
fusion  architecture  (hence  even  the  optimal  decision  rules  for 
the  fusion  architecture),  the  performance  of  the  tandem 
architecture  is  always  at  leas:  as  good  as  the  performance  of 
the  fusion  architecture.  Thus,  we  will  restrict  ourselves  to  the 
Study  of  the  tandem  architecture. 


FIGURE  2 

TWO  DM  ORGANIZATIONS 
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2.2  The  ROC  Curve 


FIGURE  1 

L  UNO  RANGE  OBJECTIVES 
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In  the  binary  hypothesis  testing  problem  each  DM  car, 
be  characterized  by  his  Receiver  Operating  Characteristic 
(ROC)  Curve.  This  curve  plots  the  probability  of  detection  as 
a  function  of  the  probability  of  false  alarm. 


The  probability  of  detection.  PD.  is  the  probabiinv  that 
the  DM  decides  u  =  1  (indicating  that  H.  is  the  true 
hypothesis)  when  H,  is  indeed  true  ar.c  is  defined  by 

R,  =  j  P,,u  (a  :  H  ,  d.\  n;. 

t  “'1 

where 


A(y) 


P(y  !  H.) 

P(v  I  Kci 


is  the  likelihood  ratio  and  n  represents  the  decision  threshold. 


The  probability  of  false  alarm.  PF,  is  the  probability  that 
the  DM  decides  u  =  l  when  Hc  is  the  true  hypothesis  and  is 
defined  by 

pF  =  1^'VHpdA 

K.  C 


Thus,  the  ROC  curve  is  expressed  by  two  parametric 
equations,  with  the  threshold  parameter  r,  varvinc  from  zero 
to  infinity;  in  general,  car,  no;  be  expressed  in  a  closed  form. 
Tne  ROC  curve  is  concave  and  it  has  another  useful  properm; 
suppose  that  by  substituting  n‘  in  equations  (1 )  anc  (2;.  tne 
point  (PF’.PD")  of  the  ROC  curve  is  obtained.  Tner..  the 
slope  of  the  tangent  to  the  ROC  curve  a:  (PF'.PD")  is  r.‘ 
(Figuie  3).  Consequently,  if  a  DM  performs  detection,  w-.th 
some  given  n\  his  optimal  operating  pom:  is  the  point  cf  the 
ROC  curve  where  the  slope  of  the  tangent  is  n". 

In  our  research,  we  use  the  ROC  curve  to  quantify  tr.e 
relative  expertise  of  different  DMs.  Moreover,  since  the  team 
of  DMs  aiso  performs  bir.arv  hypothesis  testtr.c.  team 
performance  can  aiso  be  quantified  by  the  team  ROC  curve. 
If  the  ROC  Curve  of  DM  A  is  higher  than  the  ROC  curv  e  of 


jc) 


n  .. 


-3- 


DM  B,  then  we  say  that  A  is  a  better  DM  than  B,  because  for 
ihe  same  level  of  probability  of  false  alarm.  A  will  have  a 
higher  probability  of  detection  (Figure  4a).  But,  the  DMs  can 
not  always  be  ranked  globally  because  sometimes  their  ROC 
curves  intersect  (Figure  4b). 


FIGURE  3 
THE  ROC  CURVE 
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FIGURE  4 

RANKING  DECISION  MAKERS 
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2.3  The  Problem 


Consider  a  team  consisting  of  two  DMs  ir.  tandem 
architecture,  which  performs  binary  hypothesis  testing 
(Figure  5a).  The  prior  probabilities  (P,  =  PF^)  for  i  =  0.1)  are 
assumed  known,  as  well  as  the  costs  J(u.H)  which  are 
incurred  by  the  team  when  it  decides  u  and  H  is  the  true 
hypothesis.  It  is  assumed  that  it  is  more  costly  for  the  team  io 
err  than  to  be  correct.  The  team  objective  is  to  minimize  the 
expected  cost  incurred  by  the  team. 

Each  DM  receives  a  conditionally  independent 
observation.  One  DM.  called  the  consultant  DM,  mattes  a 
binary  decision  (uc=  0  or  ut=  1)  based  on  his  measurement, 
vc,  and  transmits  it  to  the  othe  DM,  called  the  princv  DM. 
Then,  the  primary  DM  has  to  make  the  team  decision  (based 
upon  his  own  measurement  y  and  the  message  from  the 
consultant)  which  has  to  be  either  up=  0  or  up=  1  indicating 
that  the  corresponding  hypothesis  is  considered  to  be  true. 


The  optimal  solution  for  the  decision  rules  of  the  tuo 
DMs  is  given  by  likelihood  ratio  test  with  constant  thresholds 
[?].  For  the  primary  DM: 


If  uc  =  0  : 

If  uc=  1  : 

For  the  consultant  DM: 


ui=1  i  rr 
Afv  )  >  — 5K  n 

<  i-rc 
u  =o  1  'c 


u  =  1 


r; 


A  iv  !  - 

-p  <  pc 

U  =  0  D 


Uc-  1  pi  .  pO 

A, V  i  >  iDJi  n 

“  e*  <  r>l  r»o 

U  =  0  '  1)  D 


wnere 


Ml 
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Pt  J(1,H.)  -  JiO.H.i 
P  -  J(1  ,H,) 


and  PD>  (  Pf>  )  is  the  probability  of  detection  (probability  cf 
false  alarm)  for  the  primary  DM  when  u(  =  i  was  received  by 
the  consultant  (i  =  0.1)  and  PDC  (  Prc  )  is  the  probability  of 
detection  t probability  of  false  alarm!  for  the  consultant  DM. 
when  botr,  DMs  are  operated  according  to  the  optima, 
decision  rules  of  eqs.(3)-t5).  For  example. 


Pri'Aiv  ) 

■  T 


1  -r; 


H0) 
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Figure  5b  demonstrates  the  form  of  the  operating  points. 

The  ROC  curve  of  the  team  as  a  whole  car.  be  computed 
and  is  given  by: 

Pf’  =  (1  -  P./t  PA  -  P,‘  P 
=  n  -  p.jipa  *  p,  =  r 


■4— 


FIGURE  5 

THE  PROBLEM  AND  ITS  SOLUTION 


PRIMARY  DM  CONSULTING  DM 
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Note  that  the  team  ROC  depends  not  "nlv  upon  the 
characteristics  rexperbse".i  of  die  individual  DMs.  but  also 
on  the  parbcular  way  that  they  have  been  constrained  to 
interact  (the  leant  or  organization  architecture). 

2.4  Architecture  Comparisons 

Suppose  that  one  of  the  two  DMs  is  "better"  than  the 
other,  i.e.  his  ROC  curse  is  higher  than  the  ROC  curve  of 
the  other  DM.  There  exist  two  candidate  architectures  for  the 
leant;  either  naite  the  "better"  DM  the  primary  DM  or  maite 
the  "better"  DM  the  consultant  DM.  Recall  that  the  primary 
DM  makes  the  final  ieam  decision.  We  would  like  to 
determine  which  of  the  two  architectures  yields  better 
performance  than  the  other  tor  all  values  of  n.  that  is 
whether  the  optimal  architecture  is  independent  of  the 
external  parameters  of  the  problem  (details  of  cost  function, 
prior  probabilities;  which  determine  the  value  of  r.. 

The  architecture  with  the  better  DM  as  the  primary  DM 
was  conjectured  [?]  to  be  better.  This  comecture  is  anpealinn 
from  an  intuitive  pom:  of  view;  given  rwe  DMs  one  wouid 
like  to  have  the  "better"  DM  make  the  final  decision, 
independent  of  the  prior  probabilities  and  the  cost 
assignments.  If  this  were  the  case,  then  the  ortimal  way  of 
organizing  two  DMs  wouid  not  chance,  sav,  a?  me  pr.or 
probabilities  of  the  underlying  hypotheses  vary. 
Lnfcrtunateiy.  as  we  show  beiow.  this  conjecture  can  be 


2.5  A  Counterexample  to  the  Conjecture 

In  Figure  6,  we  present  the  ROC  curves  of  two  DMs, 
one  better  than  the  other  according  to  our  prior  definition. 
Table  1  contains  the  discrete  distributions  of  their 
observations;  the  elements  in  the  matrix  denote  probabilities. 
For  example,  the  "worse"  DM  will  observe  y  =  1  with 
probability  0.1  if  Hc  is  true  and  with  probability  0.5  if  H.  is 
true.  From  Table  1  we  can  then  see  that  the  better  DM  has  as 
good  or  better  discrimination  of  the  two  hypotheses,  and  of 
course  this  is  reflected  in  the  dominance  of  his  ROC  curve  in 
Figure  6. 

In  order  to  establish  the  counterexample  we  compared 
the  two  architectures  using  tedious,  albeit  straight  forward 
calculations  of  the  probability  of  error.  The  results  are 
illustrated  in  Table  2,  which  contains  the  probability  of  error 
for  two  different  values  o'  n  for  each  architecture  --  R 
denotes  the  "better"  DM,  while  \V  denotes  the  "worse"  one. 
For  n  =  1.0  having  the  betier  DM  as  the  consultant  is 

FIGURE  6 
THE  ROC  CURVES 
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optimal  while  for  n  =  0.38  having  the  betier  DM  as  the 
primary  is  optimal.  This  can  be  also  verified  by  deriving  tr.e 
team  ROC  curves  for  each  architecture  (Figure  7a  i.  As  the 
cicse-up  of  Figure  7b  shows  the  two  ROC  curves  intersect 
near  PF=  0.5.  Tnus.  in  this  special  example,  me  optimal  tear. 
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TABLE  2 

COMPARISONS  Or 
PROB.  OF  ERROR 
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FIGURE  7 

'EAM  ROC  CURVES 
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architecture  depends  on  the  value  of  n  (i.e.  the  numerical 
values  of  the  prior  probabilities  and  costs).  On  the  other 
hand,  tor  this  example,  both  architectures  have  vers  similar 
erforrr.ar.ee,  since  their  ROC  curves  are  quite  dose  (Figure 


3.  COMPARING  GAUSSIAN  VARIANCES 
3.1  General  Remarks 

Consider  special  case  of  the  problem  presented  in 
Section  2.3  above,  wr.ere  each  DM  receiv  es  two  independent 
observations  distributed  with  the  Gaussian  distr.rutior.  with 
different  variance  under  each  hvpothesis.  Tr.e  ROC  curves  ir. 


this  case  are  simple  and  given  in  a  closed  form  [1),  A 
summary  of  this  case  is  given  in  Table  3 

3.2  The  First  Architecture 

Suppose  that  the  bener  DM  is  made  the  primary.  Thin, 
from  the  solution  of  the  problem  and  the  property  of  the  ROC 
curve 
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where  the  superscripts  B  (better)  and  \V  <wor>4>  indie 
which  DMs  ROC  curve  is  being  differentiated  Solving 
system  of  eqs. (9)-(  11)  and  recalling  the  concasm.  <■:' 
ROC  curve,  we  obtain  that  in  this  case 


(PFi,PrM  =  G.l  i 


which  implies  that  whenever  u  =  1  is  received  from  tre 
consultant,  the  primary  decides  u„=  1  independent  of  hw  r 
observation.  Substituting  into  (~  t  and  (Si.  we  obtain  ;:.a:  ::.e 
team  ROC  curve  in  this  case  is  riven  bv: 


PJ  =  PFo  -  PFc  -  p.c  pj 

pdT  =  Po°-poc  •  pnPfV 


for  seme  (PFC.PD0)  [(PFC,PDC)]  in  the  ROC 
[better]  DM. 


TABLE  3 

COMPARING  GAUSSIAN  VARIANCES 


WORSE  DM  : 
Y.,Y.~N(0.cr) 


H0  :  c2  =  c0: 


P  =  P  ' 

D  F 


BETTER  D? 
Y..Y.-N  - 

H.  :  m  =  -  : 

O 

H.  :  t~  =  N  r 


r>  _  r- 

'  D  '  F 


with  : 


N  >  I 
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3.3  The  Second  Architecture 

Suppose  th2t  now  the  better  DM  is  made  the  primary. 
Tnen,  we  can  arbitrarily  assign  to  the  DMs  the  following 
operating  points: 

(Pfp,PDc):  to  the  Consultant  (Worse;  DM 

(P^.P^j:  to  the  Primary  (Better)  DM  when  u£  =  C  is  received 

(1,1)  :  to  the  Primary  (Better)  DM  when  uc  =  1  is  received 

Substituting  into  eqs.  (7)  and  (8),  we  obtain  eqs.  (13)  and 
(13)  again.  Since  for  this  arbitrary  assignment  of  operating 
points,  the  architecture  with  the  better  DM  as  the  primary  can 
achieve  performance  equal  io  the  optimal  performance  of  the 
other  architecture,  the  hrttf  PV  should  always  be  the 
r>V. 

3.3  Obtaining  the  Team  ROC  Curve 


4.2  Adding  a  New  DM 

By  introducing  the  "perfect"  DM  to  the  team,  that  is  2 
DM  who  always  knows  which  is  the  true  hypothesis  (i.e.  his 
ROC  curve  goes  through  (PF.PD)  =  (0.1)  ),  the  team 
probability  of  error  will  be  reduted  to  zero.  Hence, 
specifications  no  niatici  how  stnc;  car.  always  be  met. 

We  would  like  to  introduce  a  trade  off  between  the  team 
performance  and  the  quality  of  the  DM  to  be  introduces  To 
measure  quality  we  need  to  rank  the  DMs  even  in  cases  of 
ambiguity  (Figure  4b).  The  measure  we  w  ill  employ  is  the 
area  under  the  ROC  curve.  This  measure  is  scalar  and 
preserves  the  ranking  of  unambiguous  situations  (Figure  4a); 
the  "perfect"  DM  has  a  measure  of  1  and  the  '  w  orst"  DM 
(the  DM  who  is  equally  likely  io  choose  between  either 
hypothesis  independent  of  his  observation  j  has  a  measure  of 
0.5. 


Suppose  that  the  better  DM  is  the  consultant.  Then, 
from  the  system  of  eqs.  (9  >-(11;,  we  can  solve  for  Pfc  to 
obtain: 


r,  -  k  ct  <  l  -  r  >  n 


2  '  *^1  "  ®C  *  3  *  T  “  6 i 

< i1.  -  . c; •(:■!, ir. .  1 

-  a*  cf 

<=i  -  ‘i 


iMcf-  c0 


Vti-V^  "e*  (i  -ipnf 


This  is  an  equation  of  just  PFC.  We  could  have  substituted  for 
P,.c  from  the  equation  of  the  ROC  curve  of  the  consultant 
(better)  DM.  but  did  not  do  it  because  of  space  limitations.  If 
the  equation  is  solved  PFC  is  obtained.  Moreover: 


i  -  rt 


By  substituting  into  the  equation  of  the  ROC  curve  of  the 
primary  (worst)  DM.  Frp  is  obtained.  Finally  by  substituting 
for  all  the  probabilities  into  equations  (7)  and  (8).  the  team 
ROC  curv  e  is  outlined  as  a  function  of  n.  me  variances  of 
the  DMs  and  N. 

It  should  be  ciear  that  the  team  ROC  curve  will  no:  be  of 
the  same  form  as  me  ROC  curves  of  the  individual  DMs.  in 
fact,  i:  is  no:  even  given  by  a  closed  form  expression.  Thus, 
we  cannot  easily  extend  the  result  to  me  case  of  three  DMs  in 
a  tandem  architecture. 

4.  DESIGNING  ORGANIZATIONS 
4.1  General  Remarks 

Suppose  that  we  are  giver,  a  team  of  DMs  and  a  set  of 
requirements  on  me  team  performance,  which  are  no:  met. 
We  could  r reform,  several  changes  ir.  the  team,  such  as 
adding  or  deleting  a  DM  o:  changing  the  team 
interconnections,  or  redesigning  the  communication 
protocols,  to  make  the  team  meet  posed  performance 
T“cuirem?r.*s.  Prcssr.iiv.  wc  zrz  crr.?,cv'.n£  z  r.i!  <ir.c  error 
approach  because  cf  the  mamem.attcal  complexity  of  me 
problems;  we  here  for  analytical  insight  mom  our 


The  design  problem  will  now  be  to  find  the  "cheapest" 
DM  which  will  enable  the  team  to  meet  the  requirements;  b> 
cheapest  meaning  the  DM  with  the  smallest  area  under  the 
ROC  curve. 

4.3  A  Sample  Problem 


Suppose  we  are  given  a  DM  ("old")  with  ROC  curve: 


r  - 

D 


2 

1 


and  a  set  of  requirements  for  team  performance  (i.e. 
minimum  levels  of  probability  of  detection  for  specified 
levels  of  probability  of  false  alarm).  We  want  to  find  the 
"cheapest"  DM  ("new")  with  oniomorphic  ROC  curve  to  the 
old  DM.  that  is: 


p  - 

D 


.  LCD 


which  will  cake  the  learn  satisfy  the  requirements.  In  this 
case,  the  smaller  the  value  of  the  constant  K  the  cheaper  the 
DM. 


The  problem  is  the  same  as  the  one  described  ir.  Section 

2.3  above.  The  two  possible  architectures  are  to  use  the  new 
DM  as  the  consultant  or  io  use  the  new  DM  as  the  primer,  . 

In  the  following  algorithm  we  use  our  theoretical  analysis 
which  suggests  that  the  bette*  DM  should  he  tr;  r~.mr.-y  to 
avoid  a  completely  our  trial  and  error  approach. 


4.4  The  Algorithm 

STEP  G:  Start  with  two  identical  "old"  DMs 

STEP  1:  If  the  requirements  are  met,  then  the  team  is  too 
good.  Thus,  the  new  DM  can  be  worse  than  what 
he  is,  which  implies  that  the  K  of  the  new  DM  car. 
and  should  decrease.  From  our  theoretica.  analysis 
we  know  that  me  new  DM  should  be  the  consultant 
Thus,  we  decrease  the  consultant’s  K  ar.a  co  to 
STEP  3. 
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STEP  2:  If  the  requirements  are  not  met,  then  the  team  is  too 
weak.  Thus,  the  new  DM  should  be  better  than 
what  he  is,  which  implies  that  the  K  of  the  new  DM 
can  and  should  increase.  From  our  theoretical 
analysis  we  know  that  the  new  DM  should  be  the 
primary.  Thus,  w'e  decrease  the  primary's  K  and  go 
to  57F?  4. 

STEP  3:  If  all  the  requirements  are  met  and  one  is  met 
exactly,  we  stop.  If  the  requirements  are  met  then 
we  decrease  the  K  of  the  consultant.  If  the 
requirements  are  not  met  we  increase  the  K  of  the 
consultant.  We  then  repeat  STEP  3. 

STEP 4'  If  all  the  requirements  are  met  and  one  is  met 
exactly,  we  stop.  If  the  requirements  are  met  then 
we  decrease  the  K  of  me  primary.  If  the 
requirements  are  no:  met  we  increase  me  K  of  me 
primary.  We  then  repeal  STEP  4. 

Our  mecrei'.cai  analysis  indicated  wnemer  me  new  DM 
should  be  the  primary  or  the  consultant.  Using  educated 
crseises  ter  me  values  cf  K  m  our  nu!  and  error  approacr.  our 
problem  will  be  solves  efficiently. 

S.  CONCLUSIONS 

By  a  counterexample  we  nave  sr.own  that  the  optimal 
team  architecture  may  depend  on  parameters  external  to  the 
team  tenor  probabilities,  cost  structure  etc).  Hence,  we  can 
have  ambiguity  of  whether  a  pardcuiar  architecture  is  optimal 
for  all  values  of  the  external  parameters.  It  is  possible, 
however,  to  use  the  area  under  the  team  ROC  curve  to 
remove  the  ambiguity. 

Special  distributions  lead  to  architectural  comparisons 
that  are  unambiguous,  w-  demonstrated  this  in  the  case  of 
comparing  gaussian  variances,  in  which  the  better  DM 
s^rvuid  g;«'2'v  be  the  rrma~v  DM.  Computer  stmuiauons 
(not  repor.ed  here;  indicated  that  this  result  holds  true  for 
comparisons  of  means  of  gausstan  distributions,  but  the 
inherent  comoiexity  of  the  equations  prohibited  us  from 
obtaining  analytical  resuits. 

E'  en  if  the  individual  DM  ROC  curves  are  analytical, 
the  team  ROC  curve  is  not.  Thus,  it  is  hard  to  generalize  our 
resu.ts  to  teams  with  more  mar.  two  DMs.  We  hope  to  octam 
some  novel  results  to  help  us  design  more  complex 
organizations;  but.  tt  :s  not  clear  wnemer  such  results  exist. 

Finally,  we  plan  to  study  the  effects  or.  the  team 
performance  of  different  communication  protocots  as  well  as 
of  more  complex  mon-binary;  hypotneses. 
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